LEFT INVERTIBILITY OF DISCRETE-TIME 
OUTPUT-QUANTIZED SYSTEMS: THE LINEAR CASE WITH 

FINITE INPUTS 



NEVIO DUBBINI, BENEDETTO PICCOLI, AND ANTONIO BICCHI 



Abstract. This paper studies left invertibility of discrete-time linear output- 
quantized systems. Quantized outputs are generated according to a given 
partition of the state-space, while inputs are sequences on a finite alphabet. 
Left invertibility, i.e. injectivity of I/O map, is reduced to left D-invertibility, 
under suitable conditions. While left invertibility takes into account member- 
ship to sets of a given partition, left D-invertibility considers only membership 
to a single set, and is much easier to detect. The condition under which left 
invertibility and left D-invertibility are equivalent is that the elements of the 
dynamic matrix of the system form an algebraically independent set. Our main 
result is a method to compute left D-invertibility for all linear systems with 
no eigenvalue of modulus one. Therefore we are able to check left invertibility 
of output-quantized linear systems for a full measure set of matrices. Some 
examples are presented to show the application of the proposed method. 

Left invertibility, uniform quantization, finite inputs, algebraic independent set, 
discrete time, control systems 



f. Introduction 

Left invertibility is an important problem of systems theory, which corresponds 
to injectivity of I/O map. It deals so with the possibility of recovering unknown 
inputs applied to the system from the knowledge of the outputs. 

We investigate left invertibility of discrete-time linear output-quantized systems 
in a continuous state-space. In particular, inputs are arbitrary sequences of sym- 
bols in a finite alphabet: each symbol is associated to an action on the system. 
Information available on the system is represented by sequences of output values, 
generated by the system evolution according to a given partition of the state-space 
(quantization). 

In recent years there has been a considerable amount of work on quantized 
control systems (see for instance [HI [201 121] and references therein), stimulated 
also by the growing number of applications involving "networked" control systems, 
interconnected through channels of limited capacity (see e.g. [H [TJ [2S1 [22 ) ■ The 
quantization and the finite cardinality of the input set occur in many communication 
and control systems. Finite inputs arise because of the intrinsic nature of the 
actuator, or in presence of a logical supervisor, while output quantization may occur 
because of the digital nature of the sensor, or if data need a digital transmission. 

Applications of left invertibility include fault detection in Supervisory Control 
and Data Acquisition (SCADA) systems, system identification, and cryptography 
([121 US])- Invertibility of linear systems is a well understood problem, first handled 
in [BJ, and then considered with algebraic approaches (see e.g. [22]), frequency do- 
main techniques ([T7][TS]), and geometric tools (cf. [T5])- Invertibility of nonlinear 
systems is discussed in [21]. More recent work has addressed the left invertibility 
for switched systems ([21]), and for quantized contractive systems ([ID])- 
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The main intent of the paper is to show that the analysis of left invertibility 
can be substituted, under suitable conditions, by an analysis of a stronger notion, 
called left D-invertibility. The condition under which left invertibility and left D- 
invertibility are equivalent is that the elements of the dynamic matrix of the system 
form an algebraically independent set (Theorem [6]) . Therefore the set of matrices 
for which left D-invertibility and left invertibility are equivalent is a full measure 
set. While left invertibility takes in account whether two states are in the same 
element of a given partition, left D-invertibility considers only the membership of 
a single state to a single set. For this reason left D-invertibility is much easier to 
detect. Our main result (Theorem [7| is a method to compute left D-invertibility 
for all linear systems whose dynamic matrix has no eigenvalue of modulus one. 

The main tools used in the paper are the theory of Iterated Function Systems 
(IFS), and a theorem of Kronecker. The use of IFS in relation with left invertibility 
is described in [10]. The Kronecker's theorem has to do with density in the unit 
cube of the fractional part of real numbers. By means of a particular construc- 
tion illustrated in section 5 the problem of "turning" left D-invertibility into left 
invertibility can be handled with a Kronecker-type density theorem. 

The paper is organized as follows. Section 2 contains an illustrative example. 
Section 3 is devoted to the definitions of left invertibility and uniform left invertibil- 
ity. Section 4 illustrates the background knowledge. In section 5 left D-invertibility 
is introduced and main results (Theorems [6] and [7]) are proved. Section 6 contains 
a deeper study of unidimensional systems. In section 7 we present some examples 
and section 8 shows conclusions and future perspectives. The Appendix is devoted 
to technical proofs. Finally, in section 9, we collect the notations used in the paper. 



2. AN ILLUSTRATIVE EXAMPLE 

In this section we give an illustrative example, to clarify methods and the purpose 
of this paper. Consider the linear output-quantized system, in one dimension, given 
by 

x(k + 1) = ax(k) + u(k) 

y{k) = [x(k)\ (1) 
u(k) e {-1,0,1}, 

where u is the input, y is the output, a is a constant and |_ - J is the floor function. 
The left invertibility problem consists in reconstructing the unknown input sequence 
u(k) of the system from the information available reading only the quantized output 
sequence y(k). For the purpose of this example, define left invertibility in a negative 
way (see also definition [3]): if there exist two input sequences {u'(k)}, {u"(k)} and 
two initial conditions x'(0), x"(0) such that the resulting orbits {x'(k)} and {x"(k)} 
give rise to the same output, then the system is not invertible (i.e. there is an output 
sequence that does not allow the reconstruction of the input sequence) . No matter 
here how long are the sequences we are considering. Observe now that x'(k),x"(k) 
give rise to the same output if and only if the couple [x' (k) , x" (k)) € M 2 belongs to 
the set (see figure 1) 

Q = (J [M + i[x[m + i[cm 2 . 

Therefore, if there exist two orbits {x 1 {k)}^ =1 , {x" (k)}^ =l of the system ([I]) such 
that the couple [x'(k), x"{k)] € K 2 remains in Q, then the system (Jl| is not left 
invertible. For many reasons (mainly due to the "complexity" of the shape of the 
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set Q) it is much easier to check the existence of a sequence of pair of states in Qq, 
the "strip" that includes Q (see figure 1): 

Qq = {[x',x"] £ M 2 : \x' — x"\ < l} Cl 2 

The problem is then to deduce the presence of an orbit in Q from the existence of 
an orbit in Qq- We solve this problem with the help of the following remarks: 

4 Consider the orbits {x(k)'}£ =1 , {x(k)"}^ =1 of the system obtained re- 
spectively with initial conditions [x(0)'+x, x(0)"+x] instead of [x(0)' , x(0)"]. 
Then easy calculations shows that each [x(k)', x(k)"] differs from [x(k)' , x(k)"] 
by a translation along a parallel of the bisecting line of K 2 . 
£ The length of the translation of the state [x(k)', x(k)"], up to a constant, 
is proportional to a k , since 

x(k)' — a k (x(0)' + x) + terms that depend only on the sequence of u's. 

The same holds for x(k)" . 

Therefore the question is the following. Consider an orbit jfa^fc)', x(k)"] j which 

is included in Q . Does there exist a suitable translation [x,x] of the initial states 
[x(0)' ,x(0)"] such that the resulting orbit is indeed in Q? 

By 4k, as x varies in M, the initial condition is moving along a parallel of the 
bisector of M 2 , but every time it cover a distance of it is in the same relative 
position with respect to a square of Q: in other words the property of "being inside 
Q" is periodic. 

Moreover, by A the distance covered by [x(k)' , x(k)"} with respect to [x(k)' , x(k)"] 
is proportional to a k , and easy calculations shows that the property of "being inside 
<5", which is periodic, depends on the fractional parts of a k (see also figure 2). 

Theorem 1. // 1, a, a 2 , . . . , a K are linearly independent over 1, then, for every 
ao, ai, . . . , olk £ K the set of points 

{ [frac(ao + I), frac{ct\ + la), . . . , frac(a.K + la K j] '■ I £ 

is dense in the unit cube o/R if+1 . <} 

The Theorem (see also Theorem [5]) indeed assures that there exists a suitable 
translation [x,x] of the initial states [x(0)',x(0)"] such that the resulting orbit is 
inside Q. Referring to figure 3, each arrow represents the "period" 1 (in terms of 
fractional parts, to be multiplied by y2), and in particular, the values of fractional 
parts going from to the intersection of the square with the arrow correspond to 
a point inside Q. Therefore arbitrary small fractional parts, whose existence is 
assured by the Theorem, means that every point of the orbit can be positioned 
inside Q simply modifying the initial conditions in the way we showed. Indeed it 
is well known also that the numbers a £ K such that 1, o, a 2 , . . . ,a K are linearly 
independent over Z are a set of full measure. 

That's the point of this paper. In this work we solve the problem of checking the 
left invertibility of a system in arbitrary dimension, by investigating the presence 
of an orbit in the "strip" Qo, and then deducing the presence of an orbit in Q. This 
strategy works for a full measure set of parameters. 

3. Basic setting 

Throughout this paper we use the following notations: 

• 7T p is the canonical projection on the first p coordinates; 

• nw is the canonical projection on a subspace W; 
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Figure 1. The set Q is formed by the squares on the diagonal, 
while the set Qo is the strip inside the dashed line. 



• mi : R — > M. denotes the orthogonal projection on the z-th coordinate; 

• &i is the i— th vector of the canonical basis of R d ; 

• ['J is the floor function, acting componentwise; 

• frac(-) denotes the fractional part, acting componentwise; 

• (vi, . . . , Vi) denotes the linear subspace generated by the vectors Vi,...,Vi; 

• fi(S) denotes the Lebesgue measure of a set S in M d ; 

• d indicates "topological boundary of ..." ; 

• \ denotes the set difference; 

• Q[Cii ■ • ■ i Cjv] is the ring of polynomial in the variables Ci>--->CiV> with 
coefficients in Q; 

Definition 1. The uniform partition of rate S ofW is 

V = U P < = U M> ( J i + V 5 l x • • • x M. (*p + 
iezp ii,...,i p ez 

where i = i\, . . . ,i p . <£> 

We consider systems of the form 

x(k + 1) = Ax(k) + Bu(k) 

y(fe) = <z(Cz(fc)) (2) 

where A G M dxd ,S G R mxd ,C G M pxd , cc(fc) G M d is the state, y(fc) G V is the 
output, and u{k) eW C M m is the input. The map q : R p — s- Z p is induced by the 
uniform partition = Uiezp °f ^ P °f ra ^ e ^ through q : (x G Pj) n- z and will be 
referred to as the output quantizer. We assume that U is a finite set of cardinality 
n. 

Remark 1. Suitably changing bases, without loss of generality in the system Q) 
we can suppose 6 = 1 and C = tt p . <0> 
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Figure 2. The distance covered by |[x(fc)',x(fc)"] j with respect 

to is proportional to a k , along a line parallel to the 

bisecting line of R 2 . The property of "being inside Q" is related to 
fractional parts of a k which are associated with dashed line inside 
the squares. 



So we consider only systems of the form 

f x(k + 1) = Ax(k) + Bu(k) = f u{k) {x{k)) . , 

\ y(k)= [n p x(k)\. W 

Definition 2. A pair of input strings {u(i)}i^jq, {it'(z)}igN is uniformly distin- 
guishable in k steps if there exists I € N such that Vx(0), x'(0) £ M. d andVm > I the 
following holds for the correspondent orbits: 

u(m)^u(m) => [y(m+l),...,y(m + k)]^[y'(m + l),...,y'(m + k)}, 

(outputs y(i) are referred to the system with initial condition x(0) and inputs u(i), 
while outputs y'(i) are referred to the system with initial condition x'(0) and in- 
puts u'(i)). In this case, we say that the strings are uniformly distinguishable with 
waiting time I. {> 

Definition 3. A system of type is uniformly left invertible (ULI) in k steps if 
every pair of distinct input sequences is uniformly distinguishable in k steps after a 
finite time I, where k and I are constant. <0> 

For a ULI system, it is possible to recover the input string until instant m ob- 
serving the output string until instant m + k. For applications, it is important to 
obtain an algorithm to reconstruct the input symbol used at time m > I by pro- 
cessing the output symbols from time mtoroi k. 
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Figure 3. Every arrow's length is v2- The first part of the arrow, 
corresponding to small fractional parts, is the part inside a square 
of Q. 



Definition 4. Define the quantization set relative to the system to be 
Q= [J |[ii,ii + l[x...[ip,ip + l[x(e p+ i,...,e e2 }| x 



C(ei,...,e d ) 



+ l[x ... [ip,i p + l[x(e d + P +i, ■ ■ • ,e 2 d)| 



e 2d ) > C M 2rf 



C{e d+1 ,...,e 2d ) 



i.e. Q contains all pairs of states that are in the same element of the partition V . 


To address left invertibility, we are interested in the following system on M. 2d : 
Definition 5. Define the doubled system relative to the system Q) to be 



X(k + l) = 



Axx(k) + Bu(k) 
Ax 2 (k) + Bu' (k) 



(4) 



If there exist sequences {u(k)}, {u'(k)} : and an initial state in Q such that the 
corresponding orbit of Q remains in Q, then the two strings of inputs generate the 
same output for the system Q. So conditions ensuring that the state is outside Q 
for some k will be investigated to guarantee left invertibility. 
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4. Background: attractors and left invertibility 

In this section we recall some results coming from Iterated Function System 
theory (see [31 H3| for general theory about IFS), in connection with the notions of 
left invertibility. 

Definition 6. An output- quantized linear system of type is joint contractive if 
|A| < 1 for every eigenvalue A of the matrix A. It is joint expansive if |A| > 1 for 
every eigenvalue A of the matrix A. <C> 

Definition 7. Consider an output- quantized system. 

• A set A is an attractor if for all orbits {x(k)}ken it holds 

lim dist(x(k),A) = 0. 

k— foo 

Here dist(x,A) is the inf of distances between x and points of A. 

• A set X is an invariant set if 

X = [j A(X) + Bu. 
ueu 

Theorem 2. [51 114] Let a system be joint contractive. Then, for every u G U N the 
limit 4>(u) = limbec A k x + A k ~ 1 u(k — 1) + . . . + Bu(0) exists for every x and is 
independent of x. The set <j>(JA ~) is the unique compact attractor and invariant set 
of the system. <)> 



Consider now an output-quantized linear system, together with two sets, namely 
H and S: % plays the role of an attractive and invariant set, in which the dynamic 
of the system is confined, and S plays the role of a quantization set, i.e. a set 
that the state has to exit to guarantee an invertibility property. In [11) a necessary 
and sufficient condition for left invertibility of joint contractive systems is given, 
but here we state the same condition in a more abstract setting: % and S are an 
attractor and a quantization set, not the attractor and the quantization set of the 
system pj). That's because in the following we will use these results for another 
attractor and quantization set, i.e. those ones of the difference systems. 

Definition 8. The graph Gk associated to the attractor % is given by: 

• The set of vertices 

V - {«u(0)...«(k) - A k+1 {%) + A k Bu({)) + ... + Bu{k) : u(i) e «}■ 

• There is an edge from W u (a).., u (k) t° ^u'(0)...u'(fc) if an d only if u(i + 1) = u'(i), 
for i = 0, . . . , k — 1. In this case we say that the edge is induced by the input u'(k). 



Definition 9. Consider the graph Gk, and delete all vertices (together with all 
starting and arriving edges) l H u (o)...u(k) such that - H u (o)... u (fc) ^ {M. d \ S} ^ 0. This 
new graph is called internal invertibility graph, and denoted with IGk- The union 
of vertices (which are sets) of IGk is denoted by ViG h - 

Theorem 3. 10 Denote with dS the boundary of S. Suppose that H fl dS = 0. 
Then there exists a (computable) k such that Vja k — ViG k H S. 
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If instead the system ^ is joint expansive, then the map x(k) i— > x(k + l) admits 
an inverse for every u £U. Therefore it is possible to define a correspondent inverse 
system: 

Definition 10. If the system is joint expansive, the inverse system is 

2(fr + l) = A-^Zik) - Bu(k)} 

The inverse doubled system, relative to the doubled system Q), is defined in a 
similar way. <0> 

In the case of joint contractive systems, the inverse systems give rise to attractors, 
since they are joint contractive: such attractors can be described also as the set of 
initial conditions that can start a bounded orbit of the system ^ or of the doubled 
system Q: 

Theorem 4. [lOj Suppose that the system |^) is joint expansive. If there is an 
infinite bounded orbit of the system Q) or of doubled system Q), then this orbit is 
entirely contained in the attractor of the inverse system or in the attractor of the 
inverse doubled system, respectively. Consequently, if we restrict to bounded orbits, 
Theorem^ applies to these attractors. (} 

5. Difference system and D-invertibility 

Definition 11. The difference system associated with the system is 

z(k + 1) = Az(k) + Bv(k) (5) 

where z(k) £ R d , v(k) £ V = U - U = {u - v! : u £ U , u' £ U} . 

Remark 2. The difference system represents at any instant the difference between 
the two states x(k) — x'(k) = z(k) when the input symbols u(k) — u'(k) — v(k) are 
performed. So we are interested in understanding the conditions under which 

{z(k)} n {]-l,l[rx(e p+1 ,...,e d )=0. 

Indeed, this implies that y(k) ^ y'{k). The converse is obviously not true. 

Definition 12. Consider the difference system. If z(0) is an initial condition and 
(w(l), . . . , v(k2)) a sequence of inputs of the difference system, we let D k 2 (z(0), u(l), . . . , v(k2 
denote the sequence (ir p z(ki), . . . , 7r p z(/c2)) generated by the difference system 
with initial condition z(0) and input string (v(l), . . . ,v(k2))- 

Definition 13. A pair of input strings {u(i)}i e m, {u'(i)}igN is uniformly D- distinguishable 
in k steps if there exists I £ N such that Vx(0), x'(0) £ M. d and Vra > I the following 
holds: 

v(m)^0 => D^[(z(0),v(l),---Am+k))t ] - 1, If x . . . x ] - 1, lp, 

V v- ' 

k times 

where z(0) — x(0) — x'(0) and v(i) = u(i) — u'{i). In this case, we say that the 
strings are uniformly D- distinguishable with waiting time I. 

Definition 14. A system of type is uniformly left D-invertible (ULDI) in k 
steps if every pair of distinct input sequences is uniformly D- distinguishable in k 
steps after a finite time I, where k and I are constant. •(> 
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Remark 3. Thanks to Remark^ uniform left D-invertibility implies uniform left 
invertibility. <) 

The first main result is based on a density theorem of Kronecker. 

Definition 15. The numbers $i , . . . , "&m £ K are linearly independent over It if 
the following holds: 

hi, .. . , k M £ Z : ki'&i + ..., +k M i9 M = fc x = . . . = k M = 0. 

Theorem 5 (Kronecker). [16] If . . . , 'dui 1 S K are linearly independent over 
Z, i/iew, /or every a j a Af G K i/ie sei of points 

{[/rac(a + 0) f rac ( a i + ^l)> • • • j frac{a M + 1&m)] -l £R} 
is dense in the unit cube o/K. +1 . <0> 



Considering the difference system (Definition 111, we are interested in orbits com- 
pletely included in (] — 1, l[) p x (e p +i, . . . , e<j)- The following proposition shows that 
under a very weak condition orbits completely included in (] — 1, l[) p x (e p+ i, . . . , ed) 
must be bounded. 

Proposition 1. Suppose that the matrix A does not have an invariant subspace in- 
cluded in (e p+ i, . . . , ed) ■ Then there exists a bounded set I such that, if {z(k)}keN C 
(] — 1, x (e p+ i, . . . , erf) is an orbit of the difference system, then {z(k)}ken C /. 



Proof: See Appendix. <0 

Note that the set of matrices A £ R dxd that have an invariant subspace in 
(e p+ i, . . . , ed) is a zero measure set. Define now E> E (B,U) to be the set of matrices 
A £ R dxd such that the system ^ is uniformly left D-invertible, and S(B,U) to 
be the set of matrices A £ R dxd such that the system ^ uniformly left invertible. 

Definition 16. Indicate with Q[Ci, • ■ ■ , Cn] the ring of polynomials in the vari- 
ables Q with coefficients in Q. The set of numbers ot\, . . . ,aji £ C is said to be 
algebraically independent if 

Q^p((i,...,(n)£®[(i,...,{n} => p( ai ,...,a N )^0. 

Theorem 6. Suppose that in the system |5J) the set of elements of the matrix A 
is algebraically independent. Then the system is uniformly left D-invertible if and 
only if it is uniformly left invertible. This in turn implies that S(B,U) \ Sd{B,U) 
has measure zero in R dxd for every B,U. 

Proof: See appendix. <0> 

5.1. D-invertibility of output-quantized linear systems. We are going to 
show how to detect left D-invertibility of any linear systems without eigenvalues of 
modulus one. Suppose that, if A is an eigenvalue of the matrix A, then |A| =/= 1. 
Denote with E c ,E e respectively the contractive and the expansive eigenspaces of 
the matrix A, i.e. the eigenspaces relative to eigenvalues < 1 and > 1 in modulus, 
respectively. Because of the hypothesis on the eigenvalues we have E c +E e = {x+y : 
x £ E c , y £ E e } = R d . Now consider the following two systems respectively on 
E c ,E e , that are joint contractive: 

Z c (k + 1) = {TT Ec A) Zc (k)+TT Ec (Bv(k))); 



z e (k + 1) = {■K Ee A- 1 )[z e {k) - TT Ec (Bv(k))}, 
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where with z c , z e we indicate the projections of z onto E c , E e , respectively. v(k) £ 
V. The above systems must have invariant attractors T c ,T e . Let us denote with 
T the attractor 

T = T C + T e = {x + y. xeT c ,ye T e }. 
We can now apply the construction of internal invertibility graph (Definition [9]) for 
the attractor T (i.e. substituting H with T), substituting S with { ] — 1, 1[ } P x 
(e p+ i, . . . , ed), and calling a path {Vi, . . . , V{\ on IGk proper if it is induced by an 

input v eV, u^O. Denoting with d((] — 1, l[) p x (e p+1 , . . . , e<$)^ the boundary of 
(] — 1, l[) p X (e p+ i, . . . , ed) we have the following 

Theorem 7. Suppose that |A| 7^ 1 for every eigenvalue A of the matrix A, that 

T n d^Q — 1, l[) p x (e p+ i, . . . , ed)j = 0, and that A does not have an invariant 

subspace in (e p +i, . . . , ed)- Then the system is uniformly left D-invertible if 
and only if IGk does not contain arbitrary long proper paths, where k is the one 
identified through Theorem^ 

Proof: Since A does not have an invariant subspace in (e p+1 , . . . , e^}, by Propo- 
sition T] all orbits of the difference system included in (] — 1, l[) p x (e p+1 , . . . , e^} 
must be bounded, and, by Theorem [4j must be included in the attractor T. By 
Theorem [3] the system is uniformly D-invertible if and only if IGk does not contain 
arbitrary long proper paths. <} 

Remark 4. Theorem [?] gives an explicit, algorithmically implementable, way to 
compute ULDI of a system. By Theorem [6| we are able to compute ULI in the 
same way for systems with a full measure set of matrices A ( the conditions on the 
eigenspaces do not affect the full measure). <0> 

Remark 5. The technical condition T(~) d((] — 1, l[) p x (e p+1 , . . . , e^)^ = means, 

from a practical point of view, that left D -invertibility can be checked up to any finite 

precision, since the set ((] — 1, l[) p x (e p+ i, . . . , e^)^ depends only on the partition 

V , and any small "disturbance" of the rate of the partition V allows the application 
of the Theorem [?] Further details on this point are given in . <0 

6. Output-quantized linear systems of dimension 1 
Linear systems of dimension 1 assume the following form, deriving from ([3]): 

x(k + 1) = ax(k) + u(k) . . 

y(k) = [x(k)\ W 

This is a contractive system if \a\ < 1 and an expansive system if \a\ > 1. If \a\ < 1 
the invertibility problem can be solved with the methods of section 3 (see [TU]). 
The next Theorem shows a necessary condition for the ULI of a system of type Q : 
if it is not satisfied we construct inductively a pair of strings that gives rise to the 
same output. 

Theorem 8. Suppose that in the system \a\ > 2. If there exist ui,U2 € U, u\ ^ 
U2 such that \u\ — 1*2 1 < a, then the system is not ULI. 

Proof: We will consider sequences of sets of type 

S i+1 = {a(S t ) + u(i)} {a(Si) + u'(i)} V(i + 1) m 
S = [0,1[, [n 

where u(i),u'(i) <E {111,112} and V(i + 1) G V is chosen at each step to maximize 
the measure of Si+i. 
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In the sequence Q set u(l) — u\, u'{\) — u^. Since \u\ — U2I < a, there exists 
a V(l) £ V such that //(Si) > (recall that // indicates the Lebesgue measure). 
Then, for i > 1 define 

u(i) = u (i) = U\. 

Since \a\ > 2 there exists an i such that /i(Sj ) = 1, therefore, applying again 
u(io + 1) = u\ and u'(io + 1) = Ua 

fJ,{A(S io ) + Bin n A(S io ) + Bu 2 } > 0. 

So there exists ceo, x[j £ t and (it(l), . . . , w(/o + 1)), ( u '(l), • • • , u'(i Q + 1)), with 
u(l) 7^ u'(l) and u(iq + 1) 7^ tt'(io + 1)> such that for the corresponding outputs it 
holds 

(y(Q),...,y(i + l)) = (y'(0),...,y'(io + l)) 

It is then enough to point out that, since we can achieve every pair of states 
x, x 1 € Sj in the above described way, we can again go on in the same way 
and find a new instant i%, a pair of initial states Xi t o,x'i , and control sequences 
(it(l), ■ • ■ , u(ii)), (u'(l), . . . , u'(ii)), with u(ii) 7^ u'(ii), such that for the corre- 
sponding output it holds 

(y(0),...,y(k)) = (y'(0),...,y'(i 1 )). 

Finally, we can achieve by induction an increasing finite sequence, but arbitrarily 
long, of instants ik, pairs of initial states (xk.01 x' k ), an d sequences of controls 
(u(l), u(ife)), (w'(l), v! (ik)) with u{i) ^ u'(i) if i = i 3 ■ + 1 for j = 1, k — 1 
such that such that for the corresponding output it holds 

(y(o),...,y(i k )) = (y'(o),--.,y'(ik))- 

This contradicts the uniform left invertibility property. <^> 

Definition 17. A number a 6 C is called algebraic if there exists a polynomial 
p(x) € Z[x] such that p(a) — 0. In this case the minimum degree of a polynomial 
with such a property is called the degree of a. A number a € C is called trascendental 
if it is not algebraic. {> 

The following Theorem can be deduced from Theorem |6j observing that an 
algebraically independent set of one element is a trascendental number. 

Theorem 9. Suppose that a is trascendental. Then the system is uniformly 
invertible if and only if it is uniformly D-invertible. <^> 

Proposition 2. The unidimensional system is either ULDI in time 1, or not 
ULDI at all. 

Proof: A sufficient condition for uniform left D-invertibility in one step is 

Mv eV.v^O: \v\ > \a\ + 1 : 

indeed in this hypothesis Vu G V, v 7^ 

]-i,i[n {o-a-l,lD + w} = ]-l,l[n]-a + «,o + «[ = 

We now prove that if 3v e V, v 7^ : \v\ < \a\ + 1, then the system is not 
uniformly left D-invertible. Indeed in this case the system 

{axi + v = X2 
ax2 — v = x\ 

has the solution x\ = -^p[,X2 = ^xf. Since |xi|, \x 2 \ < 1 the difference system has 
the infinite orbit {xi, X2, x\, #2, . . .} C (] — 1, l[) p x {e p+ \, . . . , e^). Therefore system 
^ is not left D-invertible. <0 
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Corollary 1. Consider the unidimensional system with trascendental a. Then 
it is either ULI in one step, or it is not ULI. <0> 

Remark 6. It's easy to see that a system of the form is uniformly D-invertible 
in one step if for all u±,U2 € U it holds \u\ — U2I > \a\ + 1. Therefore we have this 
summarizing situation for unidimensional systems: 

• \a\ < 1: ULI can be detected with methods described in section 3. 

! mm Mi,« 2 eW l^i — u 2 | < \a\, the system is not ULI; 

min„ liti2 giY \ui ~ u 2\ > |o| + 1 5 the system is ULI in 1 step; 

\a\ < mm UltU2e u \ui - u 2 \ < \a\ + 1, * holds. 

• 1 < \a\ < 2: * holds. 

-A- The unidimensional system is either ULDI in time 1, or not ULDI at 
all. With the additional hypothesis of trascendence of a the system is ULI 
in one step or it is not ULI. <} 

7. Examples 

Consider the system As stated in Theorem [6j if the elements of the matrix 
A forms an algebraically independent set, then uniform left D-invertibility is equiv- 
alent to uniform left invertibility. A standard method to construct algebraically 
independent sets can be easily deduced from the following Theorem of Lindcmann 
and Weierstrass: 

Theorem 10. [2 Suppose that the numbers a±, ...,Q!jv are linearly independent 
over Q. Then e ai , . . . , e aN are an algebraically independent set. {> 

Example 1. Consider the system with 

A=( € \% e ^J, B =(\)> W = {0,±1,2} y(k) = lmx(k)\. (8) 

The two eigenvalue of A are approximately 6.3531 and 17.0974, so system Q) is 
joint expansive. The difference system is then joint expansive too. The inverse 
difference system is given by 

x(k + l)=A- 1 (x(k)-v(k)), v{k) G V = {0,±1,±2,±3} (9) 

which is joint contractive. It is possible to show (see figure 4) that the attractor of 
the inverse difference system is included in } — 1, l[xl. So the system is not 
uniformly left D-invertible. 

Moreover the elements of the matrix A, by Theorem are an algebraically 
independent set because \/5, \/2, \fl are linearly independent over Q. So by 
Theorem [#| system is not uniformly left-invertible. {> 

Example 2. Consider the system with 

/ 2 \ / 2 \ 

A=\ i 1 , B=\ 3 , W = {0,1} y(k) = [n 2 x(k)\. (10) 
\0 \) \6j 

We have so V = {0, ±1}. The three eigenvalue of the matrix are \, | and 2, 
so we can apply Theorem Therefore we split M. 3 in E c = M 2 ( identified with 
{0} x R 2 ) and E e = K (identified with K x {0} x {0} ). The attractor A e relative to 
the inverse difference system on E e is [—2,2], while the attractor A c relative to the 
inverse difference system on E c is drawn in figure 5. We are interested in orbits of 
the inverse difference system on E e that remains in } — 1, 1[, and in orbits of the 
difference system on E c that remains in ] — 1, l[xR. It's easy to see that 
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Figure 4. Attractor of system 




-25-23-21-19-17-15-13-11 -S -7 -5 -3 -1 1 3 5 T 9 1 1 13 16 17 19 21 23 25 



Figure 5. Attractor of the inverse difference system on E c . 



(I I) 1 - !. 1 [ xR ) + ( e ) fl i AcC] ] - 1, 1[ xK} = 0, 



so, no matter the behavior of the system on E e , system jjlpy is uniformly left D- 
invertible in one step, therefore uniformly left invertible in one step. <} 

The last example illustrates the difference between left D-invertibility and left 
invertibility. 

Example 3. Consider the unidimensional system with 

a = 1/2, U = {-1,0,1}. (11) 
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We are going to show that system (11) is uniformly left invertible but not uniformly 
left D-invertible. 

To show that the system is not ULDI consider the following orbit with initial 
condition x = 



\x(k) + 1, 



Xk+1 = { Im-i, 



if x(k) < 0; 
ifx(k) > 0. 



Clearly x{k) £] — 1, 1[ for every k €N, so system (11) is not ULDI. 

Nonetheless system (11) is ULI in 1 step. Consider indeed the quantization set 
(defined in Definitional) 

Q= [j[i,i + l[x[i,i + l[ 



and observe that 



u 
u' 



, f| Q = Vu ^ u'. 



This in turn implies that system (11) is ULI in 1 step. <0 



8. Conclusions 

In this paper we studied left invcrtibility of output-quantized linear systems, and 
we proved that it is equivalent, under suitable conditions, to left D-invertibility, a 
stronger notion, much easier to detect (Theorem [7]). More precisely the condition 
under which left invertibility and left D-invertibility are equivalent is that the ele- 
ments of the dynamic matrix of the system form an algebraically independent set. 
Therefore the set of matrices for which left D-invertibility and left invertibility are 
equivalent is a full measure set (Theorem [6]). Moreover there is a standard way to 
create matrices whose elements are an algebraically independent set (Theorem [To]). 
Notice that algebraic conditions play a central role in investigation of left invert- 
ibility of quantized systems as well in other fields when a quantization is introduced 
(see for instance [H[8]). 

Future research will include further investigation on the equivalence between left 
invertibility and left D-invertibility to matrices whose elements are not algebraically 
independent. 



Appendix 

Proof of Proposition [lj Define the following sequence of sets: 

( S = Ker(ir d _ p ) (= (e p+1 , . . . , e d )) 
\ S l+1 =A(Si) nKer(Tr d -p). 

Then A does not have an invariant subspace included in Ker^d-p) if and only if 
Sd-p = {0}. To prove this, first of all observe that Si is a subspace of Ker(-Kd- P ) 

for every i £ N. Moreover it holds that Si is a subspace of Si-\ for every i = 1, 

To prove this, by induction: 

• Si = A(So) n So is clearly a subspace of So; 

• Suppose that Si is a subspace of Si_i. Then Si+i = A(Si) D Ker(iTd-p) is 
a subspace of A(Si-i) n Ker(nd- P ) = Si. 
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Suppose that there exists a subspace W C KeriiXd-p)- Then W C A l [Ker(7Td- p )] 
for every i = 0, . . . , d — p. This in turn implies that Sd- P ^ {0}. 

Viceversa, suppose that Sd- P 7^ {0}. Since the length of the sequence {So, • • ■ , Sd- P } 
is d+1, there exists j G {0, . . . , d—p} such that dim(Sj) = dim(Sj+i) — dim[A(Sj)n 
Ker(TTd-p)], where we indicate with dim the dimension. But Sj+i is a subspace 
of Sj, and this in turn implies that Sj — Sj+i- Moreover both are subspaces of 
Ker(ir d - p ). So 

Sj+i = A(Sj) n Kerfa-p) = Sj. 

Therefore A{Sj) — Sj because dim[A(Sj)] < dim(Sj). So Sj is an invariant sub- 
space of Ker(iTd- P )- 

Consider now the following succession of sets: 

5 = (]- 1, lQ^x if er(^_ p ) 
S l+1 = A{Si) n (] - 1, l[) p x Ker(w d - P ). 

Since Sd- P = {0} (a point) Sd- P must be bounded. Finally, observe that Sd- P 
is exactly the set of possible states z(d — p) when every z(0), . . . , z(d — p) is in 
(] — 1, l[) p x Ker(ir p ). The Proposition is thus proved. 

Proof of Theorem |6] 

Definition 18. Let us parametrize the possible pairs of states (x,x') £ R 2d such 
that x' — x € (] — 1, l[) p x (e p +i, . . . , e^) wii/i the set 

Q' = { • • • + s l> • • • )tp + s p; ^p+lj ■ ■ ■ ,td) '■ hi tj G IK; s /c G] — 1; 1[} ■ 

Moreover define 

0; ; = {(i,< + s)e]R 2 : t€R, S6]-1,1[}C (e u e d+l ), 

If X = (h, ...,td,h+si,...,t p + s p ,t p+ i, ...,t d ) e <2', /or i = 1, . . . ,35 de/me 
(ii(JC) to &e i/ie distance, measured along the line 

{<!,..., ^^r^ , . . . ,£d,£i + Si, . . . , +Si, . . . ,t p + s p , t p+ i, . . . ,td : Tj G M} 

varies varies 

from the set Qi = {X G M 2d : re^JC = for j ^i,i + d}. 

Lemma 1. Fia; a sequence {C/(i)}jeN of inputs for the doubled system Q). Suppose 
that Ve > 0, Vm £ N, Vsi, . . . , s p e] — 1, 1[, there exists t\, . . . , td, tp+i, ■ • • ,t d € K 
suc/i i/iaf, j/ {^C/)}jlo C Q' is the orbit of the doubled system j^p with X(0) = 
(ti, . . . ,td,t\ + Si, . . . , t p + s p , t p+ i, . . . , td), then the following holds 

for every i = 1, . . . ,p, j = 1, . . . , m. XTien i/ie system is not ULI. 
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Proof: Suppose that an orbit {X(i)}^-y of the doubled system is included in 
Q' and consider the 2-dimensional plane spanned by (ei,ed+i)- Observe that 
frac ( ^^f^ ) — if and only if X(J) belongs to some translation of fij along 
the bisecting line of the 2-dimensional plane (ei,ed+i), that is entirely included in 
Qi, i.e. a translation that takes fl; to the "bottom-left boundary" of a square of 

Qi. 



Suppose now that the relation (12 1 is satisfied for every e. It's now easy to see 

that, for every X e Q' there exists e > such that, if frac ( ~^|p j < e then the 

projection of X on Q\ is indeed in Qi (thanks to the periodicity of the property 
of "being in Qi' , see also the illustrative example). Therefore, if the relations (12) 
are satisfied, then there exists an arbitrary long orbit included in Q. () 

Proposition 3. Suppose that the entries of a matrix A = {ay} £ ]R dxd are an 

(k) i. 

algebraically independent set, and denote with oj- the entries of the matrix A . 
Then the set 

[af : i,j = l,...d; k = l,...,x} (13) 
is a linearly independent set for every N S N. 

(k) 

Proof: First, note that all a\j are polynomials of degree k in the ay s. Since 
the aij are algebraically independent, they can be treated formally as the inde- 
pendent variables of polynomials in d 2 variables (more precisely there exists a ring 
isomorphism between Q[an, ai2, • ■ ■ , add] and the ring of polynomials in d 2 vari- 
ables Q[xi, . . . ,Xcp], see [T]). If a nontrivial linear combination of the elements of 



the set ( 13 ) is zero, then there exists a nontrivial polynomial in the ay which is 



zero, so there exists a k such that a nontrivial linear combination of the a^^'s, 
seen as polynomials in the ay 's, which is zero. These are the entries of the matrix 
A k ° , so there would exist a nontrivial linear relation among these entries. Suppose 
this is the case. If this linear relation results in a linear relation among polynomials 
which is not identically zero, we are done. Indeed, if there exists Ayfc € Q and 
xn, . . . ,Xdd € K such that (note that the entries a\j of the matrix A k ° are seen 
as polynomials in the variables an, . . . , a^, renamed as Xy\, . . . , x^d) 

^2^ijk aij°> (xu, . . . ,x dd ) t^O, 

then, substituting the ay's to the Xij's, it is not possible that 



\jk &ij («11) • • • i a dd) — 0, 



since the ay's are algebraically independent. 

Therefore we only have to show that it is not possible that 

\ijko<Hj{xiU ■ ■ -iXdd) = 0, 

i.e. that this polynomial cannot be identically zero. Now note that the matrices 
M = {rriij} € R dxd whose entries do not satisfy the (nontrivial) linear relation 
J2i j Kjko m ij = form a full measure set, dense in R dxd . On the other hand 
also the matrices with distinct eigenvalues form a full measure set, dense in M dx<i . 
Therefore there exists a matrix M = {my} having distinct eigenvalues, whose 
entries do not satisfy the linear relation ^ Ayfc Wy = 0. 

Since M has distinct eigenvalues, there exists a matrix B such that B k ° = M (di- 
agonalize and take fep-roots of the eigenvalue). Denote with the entries of the 
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matrix B k °: then the b^'s do not satisfy the linear relation J2i j ^ijk b\^ a> = 
since B k ° = M. This implies that £\ . A 
zero as a polynomial. <)> 



(fco) 



Jko) 
j j • ■ ijk LL ij 



(xii, . . . , Xdd) is not identically 



We now prove Theorem [6] Consider the state X(m) of the doubled-system Q 
at instant m given by an initial condition X(0) € Q' and an input sequence 



U(l) = 



u(l) 



,C/(m) = 



u(m) 
u'(m) 



£UxU 



Then 



X(m) = 



A V" / B«(m) 

A J A o + .-.+ ^ Bu , {m) 

Suppose that the id— dimensional) system ^ is not uniformly left D-invertible. 
So there exists arbitrarily long orbits of the (2d— dimensional) doubled-system Q 
included in Q' . 

In the following we provide conditions such that Ve > 0, Vm € N, Vsi, . . . , s p € 
] — 1, 1[, there exists t\, . . . , td, tp+i, ■ ■ ■ , td € K such that, if {X(j)}JL. is the orbit 
of the doubled-system Q with X(0) = (ti, . . . , td, t\ + s\, . . . , t p + s p , t p+1 , . . . , td), 
then the following holds 

'd j(X(j)) \ 
V2 J 

for every i — 1, . . . ,p, j = 1, . . . , m. Therefore the system will be not uniformly 
left invertible by Lemma [T] These conditions will be verified by a full measure set. 
Consider the set 



frac 



< e, 



(14) 



cdx d 



{ a ij}ij=i * s an algebraically independent set} 



Set A e §'. For i = 1, . . . ,p, w/ ei<ed aX(j) has the form 



mX(j) 
w i+d X(j) 



T {i,i+d) 



( a u 



adi 




V o 



A 
A 



aid 



add 
an 



Qdl 



Z(0) 



A 
A 



J'-l 



\ J 





aid 
add / 



0') t , 0) * ± 



17(1) 
/ *1 \ 



h + ai 



tp -\- Sp 



V U J 



const. 



const. 



where is the entry (£, J) of the matrix A 3 . By Proposition 

is a linearly independent set, so, by Kronecker's Theor em (Theorem |5[) there exists 
a choice of (ti . . . , td, £ P +i, ■ ■ ■ ,td) such that equation ( 12 ) is satisfied, and Lemma 
[Tjthus apply. 



the set 



,0) 



l = l,...d; j = l,...N} 
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To prove that the set of matrices with algebraically independent entries are a full 
measure set, first observe that the set of polynomial P € Q[Ci, ■ ■ ■ , Cd 2 ] is countable. 
For a single polynomial P the set 

0p = {(x 1 ,...,x d 2)eM d2 : P{x 1 ,...,x d 2) = o} 

is a finite union of manifolds of dimension at most cP — 1. So the measure of Op is 
zero. Moreover 

S' = (J Op, 

i.e. §' is a countable union of sets of measure zero, which in turn implies that the 
measure of S' is zero. <) 



9. Notations 

The authors made an effort to simplify notations, though they are intrisically 
complex. For this reason in this "special" section we collect the notations used in 
this paper, ordered as their appearance. 

V = (J V% is the uniform partition (Definition [l| ; 
U is the finite alphabet of inputs (just after the Definition [T]); 
q : (x € Vi) i-> i is the output quantizer (just after the Definition [lj ; 
Q is quantization set (Definition [4| ; 
A denotes the attractor of a system, (Definition [7| ; 
I denotes the invariant set of a system (Definition [7| ; 

• 4> indicates the function that associates to each input sequence its limit 
point (Theorem [I|; 

• Gk , IGk are respectively the graph of depth k associated to the attractor 
A, and the internal invertibility graph (Definitions [8j [9|; 

• Vic k denotes the union of vertices (which are sets) of the internal invert- 
ibility graph (Definition [9| ; 

• V = U — U = {u — u' : u € U, u' 6W} is the input set of the difference set 
(Definition [IT]) 

• D k k \ (z(0), u(l), . . . , v{k 2 )) denotes the sequence (w p z(ki), . . . , ir p z{k2)) gen- 
erated by the difference system with initial condition z(0) and inputs v(l) . . . , 1 
(Definition p]); 

• E>d(B,14) denotes the set of matrices A € R dxd such that the system ^ is 
ULDI (before Theorem [6); 

• E>(B,U) denote the set of matrices A £ R dxd such that the system ^ is 
ULI (before Theorem [6}; 

• Q' = |(*i> • ■ • i td, t\ + si, . . . , t p + s p , tp+i, ■ ■ ■ ,td) ■ U,tj € K, Sfc €] — 1, 1[| 

• di(X) is the measure of a distance defined in Definition pi 



fli is the union of the two coordinate axes of (e^, ed+i) (Definition 18); 
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